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(54) Memory management for a video decoder 

(57) An MPEG compatible decoder receives encod- 
ed, compressed data in the form of image representa- 
tive pixel blocks. The decoder includes a frame memory 
(20) for storing reconstructed pixel blocks incident to the 
decoding process. The previously decompressed data 
is re-compressed (30) before being written to the mem- 



ory. Stored decompressed data is decompressed for 
display (34, 26), or as needed for decoding functions 
such as motion compensation processing (32, 22). The 
compression performed before writing data to memory 
is block-based compression using compressed data 
from one of two different compression paths which com- 
press a given pixel block simultaneously. 
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Description 

This invention concerns a system for processing an image representative digital signal. In particular, the invention 
concerns a memory management technique in an MPEG compatible image signal decoder 
5 Rapid advances in digital signal processing technology have produced corresponding advances in digital image 

signal processing in various fields, including direct broadcast satellite and high definition television (HDTV), for example. 
The MPEG (Motion Picture Experts Group) signal processing standard (ISO/IEC 13818-2. May 10, 1994) is a related 
development. This widely accepted image processing standard has been found to be particularly attractive for use with 
satellite, cable and terrestrial broadcast systems including high definition television (HDTV) systems. 
10 In an MPEG video signal decoder, more than one image frame of memory is typically needed for decoding an 

MPEG coded digital datastream, which represents I, P and B image frames as known. Three frames of memory are 
generally needed for decoding an MPEG datastream, two frames of memory are needed to storareference 1 or P frame _ 
data, and one frame of memory is used to store B frame data. For example, a conventional MPEG decoder in a direct 
broadcast satellite receiver decoder may contain 16 Mbits of random access memory (RAM), and an MPEG decoder 
^5 in an HDTV system such as that proposed by the Grand Alliance in the United States will require approximately 80 
Mbits of RAM. At the present time the cost of such amounts of RAM is significant. The need to limit memory require- 
ments, particularly in consumer products such as video and television systems, is important to keep to costs of such 
products at a reasonable level. 

In accordance with the principles of the present invention, it is herein recognized as desirable to manage the 
20 memory requirements of a digital image processing system efficiently, particularly in the case of MPEG compatible 
systems which may find extensive use in consumer products. 

In an image signal decoder employing the principles of the present invention, previously decompressed image 
data is compressed before being written to memory used in the decoding process. In a disclosed MPEG compatible 
decoder embodiment, the data is compressed before being written to image frame memory, and the stored data is 
2S decompressed for display or when needed for MPEG decoding functions such as motion compensation processing. 

In accordance with a feature of the invention, the compression is block-based compression using compressed 
data from one of two different compression paths. 

Brief Description of the Drawings 

30 

Figure 1 is a block diagram of a portion of an MPEG decoder employing the principles of the present invention. 
Figure 2 depicts memory mapping for full and reduced memory situations. 
Figure 3 is a block diagram of a compression network useful in the MPEG decoder of Figure 1 . 
Figures 4 and 5 show additional details of the network of Figure 3, 
3S Figures 6 and 7 depict pixel arrangements helpful in understanding aspects of the operation of the networks shown 

in Figures 4 and 5. 

Figure 8 depicts an alternative dual path compression network. 

Figure 1 depicts a portion of a video signal processor such as may be found in a television receiver or a satellite 
receiver The video processor includes a conventional MPEG decoder constituted by blocks 10, 12, 14, 16, 18, 20 and 

40 22. An MPEG encoder and decoder are described, for example, by Ang et al., "Video Compression Makes Big Gains, 
" IEEE Spectrum, October 1991. in accordance with the principles of the present invention, the MPEG decoder addi- 
tionally includes block compressor unit 30 for compressing data before being written to frame memory. 

The system of Figure 1 receives controlled datastream of MPEG coded compressed data from a preceding input 
processor, eg., a transport decoder which separates data packets after input signal demodulation. The received data 

-^5 is in the form of data blocks representing 8x8 pixels (picture elements). This data represents both intraf rame information 
that has been coded, and interframe predictive motion coded residual image information representing the image dif- 
ference between adjacent picture frames. The interframe motion coding involves the generation of motion vectors that 
represent the offset between a current block being processed and a block in a prior reconstructed image. The motion 
vector which represents the best match between the current and prior blocks is coded and transmitted. Also, the dif- 

50 ference (residual) between each motion compensated 8x8 block and the prior reconstructed block is DCT transformed, 
quantized and variable length coded before being transmitted. This motion compensated coding process is described 
in greater detail in the Ang, et al. article mentioned above. 

The input compressed pixel data blocks are buffered by unit 10 before being variable length decoded by unit 12. 
Buffer 1 0 exhibits a storage capacity of 1 .75 Mbits in the case of a main level, main profile MPEG datastream. Decoded 

55 compressed data from unit 12 is decompressed by inverse quantization unit 14 and by inverse discrete cosine trans- 
formation (DCT) unit 16 before being applied to one input of an adder 18. The step size provided by inverse quantizer 
14 is controlled by a signal from buffer 10 to assure a smooth data flow. Decoded motion vectors are provided from 
decoder 12 to a motion compensation unit 22 as will be discussed below. Decoder 12 also produces an inter/intra 
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frame mode select control signal, as known, which is not shown to simplify the drawing. The operations performed by 
units 12, 14 and 16 are the inverse of corresponding operations performed at an encoder, eg., at a transmitter. The 
MPEG decoder of Figure 1 reconstitutes the received image using known MPEG processing techniques which are 
described briefly below. 

5 A reconstructed pixel block is provided at the output of adder 1 8 by summing the residual image data from unit 1 6 

with predicted image data provided at the output of motion compensation unit 22 based on the contents of frame 
memory 20. When an entire frame of pixel blocks has been processed, the resulting reconstructed image is stored in 
frame memory 20. In the inter-frame mode, motion vectors obtained from decoder 12 are used to provide the location 
of the predicted blocks from unit 22. 

10 The image reconstruction process involving adder 1 8, memory 20 and motion compensation unit 22 advantageous- 

ly exhibits significantly reduced memory requirements due to the use of block based compressor 30 in accordance 
. with theprinciplesof the present invention. Specifically, the amount of memory required for frame memory 20 is reduced 
by a predetermined amount, eg., 50% (or more) as a function of the compression performed by unit 30. Additional 
details of compressor 30 will be discussed with respect to Figure 3. 

^5 A pictorial representation of the reduced memory requirements of memory device 20 is shown in Figure 2. In Figure 

2, the memory map on the left represents a mapping of pixel blocks within a full size memory The map on the right 
illustrates how a 50% smaller memory is used to store blocks compressed by unit 30. As will be seen from the following 
discussion of the compression network shown in Figure 3, each block (eg., block C) is guaranteed to fit within 50% of 
the space normally required for a full size memory, or less. That is, the compression provided by unit 30 is 50% or 

20 more. In this example any unused memory space remaining after compression is left unused so that the starting position 
of the data for any block is a known location, or starting address. 

In the full size memory, any particular pixel can be located and accessed because of a fixed mapping between the 
video frame pixels and the memory pixel addresses. The reduced size memory does not exhibit pixel-by-pixel mapping. 
Instead, pixel blocks are mapped into the memory. If a particular pixel from within a particular block is needed, it may 

2S be necessary to access the entire block of data. 

A conventional MPEG 2 main level, main profile system (720 x 480 pixels) requires a frame memory capacity of 
12,441,600 bits for storing three video frames. By compressing these frames 50% before storage in accordance with 
the present invention as discussed above, only 7,970,800 bits of memory are required for MPEG decoding. That is, 
6,220,800 bits of frame memory for unit 20 and 1,750,000 bits of buffer memory for unit 10. Therefore if the system 

30 employs a typical 1 6 MBit external memory device, only about 8 Mbits of memory space are needed for MPEG decoding, 
leaving the remaining external memory capacity available for other purposes such as on-screen display, microprocessor 
RAM, transport buffers or other special buffers, for example. As smaller integrated circuits are developed, it may be 
possible to integrate the decoder memory on the same integrated circuit with the other decoder networks. Reducing 
the memory requirements in an HDTV decoder system will result in significant savings. For example, in the HDTV 

3S system proposed by the Grand Alliance in the United States, the frame memory requirement is 

1 920 X 1 080 x 1 2 X 3 = 75,202,560 bits. 

40 With 50% compression, the memory requirement is reduced to 37,601 ,280 bits. 

The use of compression by means of compressor 30 prior to storing data in memory 20 requires that data be 
decompressed prior to unit 22 in the motion compensation processing loop. This is accomplished by block-based 
decompressor 32, which exhibits the inverse of the operation exhibited by compressor 32. Block-based decompressor 
34 is similar to unit 32 and decompresses stored pixel blocks before being conveyed to a displayed processor 26. 
■^5 Processor 26 may include, for example, circuits for conditioning the pixel data for display, a display driver network, and 
an image reproducing device. 

The described memory reduction technique may be used with an MPEG 2 main level, main profile decoder which 
is capable of decoding MPEG 2 datastreams with image resolution up to COIR 601 (720 x 480 pixels). The technique 
is equally applicable to MPEG 1 datastreams, and to other image resolutions including high definition formats such as 
50 may be associated with broadcast, cable and satellite television signals, and other types of information bearing signals. 

Data from stored anchor frames such as I frames is generally accessed in a random fashion according to the 
motion vectors received in the input compressed data stream. A block based compression scheme maintains reason- 
able accessibility of pixel data from the frame memory. An 8 x 8 pixel block has been found to work well with the 
disclosed compression scheme. Larger pixel blocks allow the use of sophisticated compression techniques at the 
55 expense of reduced pixel accessibility. Smaller blocks allow finer granularity in accessing pixels at the expense of fewer 
options for compression. Various types of compression, including quantization and transformation, may be used to 
implement the function of compressor 30 depending on the requirements of a particular system. 

The type of compression used should preferably, but not necessarily, exhibit certain characteristics. Each block 
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should be compressed a predermined amount, or more, so that the location of each compressed block is easily deter- 
mined, as discussed in connection with the memory mapping shown in Figure 2. Each block should be compressed/ 
decompressed independently of other blocks. Thus any block can be accessed without having to read any other block. 
Ideally the compression/decompression process should be lossless, but this cannot be guaranteed for any size block. 

5 Thus the compression/decompression process should not produce objectionable artifacts in a reproduced image. 

A particularly advantageous compression technique for use by compressor 30 is shown in Figure 3. This com- 
pression technique uses a variable compression network in parallel with a fixed compression network. The compression 
networks operate concurrently on the same pixel block. The variable compression network has the advantage of being 
lossless or substantially lossless, and is the preferred compression network. If the variable compression network in 

10 not successful in achieving a predetermined desired amount of data compression, the output of the fixed compression 
network is used instead. While. the fixed compression network can obtain the desired amount of compression, this 
network has the disadvantage of being lossy. . . 

In Figure 3, data from source 1 8 is applied to an input terminal 31 2 of a data compression network including parallel 
independent data compression paths 314 and 320. Path 314 is a substantially lossless path and includes a variable 

15 compression processor 316 which provides compressed data to one of the signal inputs of a multiplexer (MUX) 325, 
and a bit counter 318. Counter 318 monitors the bit count of each data block compressed by unit 316, and provides a 
switching control signal to a control input of MUX 325. Additional details of compression path 314 are shown and will 
be discussed inconnection with Figure 4. Path 320 is a lossy path which includes a fixed compression processor 322 
as shown in greater detail in Figure 5. Compressed output data from unit 322 is provided to another signal input of 

20 MUX 325. MUX 325 provides either the compressed data from path 314 or the compressed data from path 320 to an 
output terminal 328 of the compression network as will be explained in greater detail below. The output compressed 
data is provided to frame memory 20 of Figure 1 . 

Block based compression network 314. 320 compresses each pixel block independently and essentially guaran- 
tees that each block will be compressed by a predetermined compression factor or more. The output of either com- 

25 pression path 314 or path 320 is selected for input to memory 20 so as to provide satisfactory image quality and the 
desired compression factor (50% in this example). Compression factors greater than 50% also may be used. However, 
it has been determined that compression factors not exceeding 50% produce good results. A compression factor of 
25% is essentially transparent compared to conventional decoder processing without such compression. At 50% com- 
pression the results are less transparent, but the results are acceptable and are not considered to be significantly 

30 different compared to conventional decoder processing without memory reduction. 

The multipath nature of the compression network achieves high image quality and assures that at least the fixed 
compression factor will be achieved. Variable compression path 314 exhibits lossless or near-lossless compression, 
but the number of output bits provided by path 31 4 is variable. The number of compressed block output bits from path 
314 is monitored by counter 318. If the number of compressed block bits 314 is equal to or less than a predetermined 

35 target bit count associated with the predetermined compression factor, the compressed data output from path 314 is 
selected by MUX 325 and conveyed to memory 20. Otherwise, the compressed block output from fixed compressor 
322 is used. Fixed compressor 322 uses a lossy compression routine with quantization to produce a fixed target bit 
output. To facilitate decompression, for each compressed block, each compression network inserts signalling informa- 
tion into the datastrearri to indicate the type of compression that was performed on the block. The signalling information 

40 could be one or more bits inserted at the beginning of each compressed data block, eg., in a header. The signalling 
bits are sensed by decompression networks 32 and 34 (Figure 1) which perform the inverse of the compression that 
was used to compress the block associated with the given signalling bits. The header may contain other control infor- 
mation, such as quantization control information for example. 

Variable compression is preferably used in smooth areas of an image to avoid annoying contouring artifacts. Image 

45 quality is essentially guaranteed to be high over such areas because variable compressor 316 uses little or no quan- 
tization, which is a substantially lossless process. On the other hand, fixed compressor 322 may be used in image 
areas containing significant detail information. Since quantization noise in such areas is not likely to introduce much 
perceptible error, the perceived quality of an image area subjected to fixed compression in path 320 will very likely be 
good. However, it is not necessary to selectively use variable and fixed compression in this manner, although in many 

50 systems it will be beneficial to do so. The choice of which of the two compressed blocks to use is simply based on the 
bit count of the compressed block from variable compressor 316. If the bit count indicates that compressor 16 has 
achieved the desired compression, it is used. Otherwise, compressor 22 is used. 

The block based compression performed by compression network 31 4, 320, and the independent compression of 
every block, allows a decoder to decode every block without needing information concerning any other block. Since 

55 each block is compressed by a predetermined compression factor, the memory address of the first pixel of each block 
is known in advance. Thus each block can be accessed from memory without information concerning any other block. 
In this regard it is noted that areas are reserved in memory for each block. In the case of 50% compression, each 
reserved area is the size of half the original block. Thus each compressed block will fit in the memory area reserved 
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for it due to the fact that bits are counted and the output of compressor 322 is used if necessary. If preferred compressor 
316 is successful in achieving greater than the target compression amount, the output of compressor 316 is used, and 
some of the reserved memory space is not used by the compressed block data. That is. each compressed block begins 
to fill its reserved memory area beginning with a predetermined starting address and continuing to an address less 

5 than the last address reserved for that block. This process is discussed in connection with Figure 2. 

It is desirable for block based compression to be capable of achieving both high compression efficiency and easy 
access to each pixel of a pixel block, even though these two results are competing in nature. That is, high compression 
efficiency requires a large block size, while easy access to pixels requires a small block size. It has been found that 
both of these characteristics can be substantially achieved with pixel block sizes of 8x8 pixels and 16x4 pixels. The 

10 blocks are formed into the required NxN pixel sizes in unit 10 as mentioned previously 

In this example each field based pixel block is scanned in a raster manner as shown in Figure 6, from left to right 
in a downward direction. This scanning is done in both units 316 and 322 using delay elements 452-456 and delay 
elements 552-556 as shown in Figures 4 and 5 respectively as will be discussed. The variable compression network 
is shown in Figure 4. This network uses a DPCM loop with adaptive prediction to produce a difference signal (residual) 

15 using known techniques. This difference is variable length coded, and the resulting number of coded difference bits is 
monitored to indicate whether or not the desired compression factor was achieved for the current block. 

In Figure 4, differencing network 442 produces an output representing the difference (residual) between input pixel 
values applied to a non-inverting input (+) of unit 442 and predicted pixel values applied to an inverting input (-) of unit 
442, respectively. The predicted value is obtained using a DPCM processing loop including differencer 442, variable 

20 length coder 444 and a variable length decoder 446 which performs the inverse of the coding operation performed by 
unit 444. The variable length coder can include an optional high resolution quantizer and an entropy encoder (eg., a 
Huffman coder) for lossless or near lossless compression. The variable length decoder includes an inverse quantizer 
and entropy decoder. The inversely decoded output from unit 446 is summed in a unit 448 with an output from a 
prediction network including a predictor 450 and associated pixel delay elements 452, 454 and 456. These elements 

25 provide delays of one, seven and one pixels, respectively. A predicted pixel value output from unit 450 is applied to 
inputs of adder 448 and differencer 442. 

Figure 7 shows an exemplary arrangement of a group of four pixels A, B, C and X (the pixel to be predicted) 
associated with the predictive processing and coding operation of the DPCM network. This group of pixels is also 
referenced in the pixel block shown in Figure 6. In this example pixel B is delayed by a one pixel interval relative to 

30 pixel C, pixel A is delayed by a seven pixel interval relative to pixel B, and pixel X is delayed one pixel inten/al relative 
to pixel A. The DPCM prediction process is well-known and will be discussed subsequently. Compressed pixel data 
from the output of variable length coder 444 are buffered by a unit 460 before being provided to MUX 325 of Figure 3. 
Buffer 460 stores the output of the variable compression process until the entire block has been processed, at which 
time it can be determined whether or not the target compression factor has been reached. 

55 The bit count of each compressed block output from coder 444 is monitored by bit counter 418, which may be 

implemented by any of several known techniques. After each pixel block has been variably compressed, counter 418 
provides a Control output signal if the compressed bit count is at or below a predetermined threshold, indicating that 
the desired amount of compression has been reached or exceeded by the variable compressor. This Control signal is 
applied to the switching control input of MUX 325 for causing MUX 325 to convey the output from the variable length 

40 compressor to the utilization network. Otherwise, the compressed block output (for the same pixel block) from the fixed 
length compressor is conveyed to the utilization network. 

The fixed compression network is shown in Figure 5. This network also uses a DPCM loop with adaptive prediction, 
as in the case of the variable compressor. In Figure 5 elements 548, 550, 552, 552, 554 and 556 perform the same 
functions as corresponding elements in Figure 4. Differencing network 542 also serves the same purpose as unit 442 

45 in Figure 4 for producing a residual pixel value, but in a slightly different context as discussed below. 

The fixed compression network uses non-linear quantizing of the difference (residual) pixel values provided at the 
output of unit 542 as a result of DPCM processing. A non-inverting input (+) of unit 542 receives input pixel values 
delayed 64 pixel intervals by a 64-pixel delay element 555. The inverting input (-) of unit 542 receives predicted pixel 
values from predictor 550. The residual pixel value output from unit 542 is subjected to quantization and inverse quan- 
go tization by units 556 and 558 respectively. The quantization provided by unit 556 is fixed and guarantees a desired 
fixed amount of data compression. For example, to achieve 50% compression of an 8-bit data word, unit 556 rennoves 
the last four least significant bits. The amount of fixed compression is not less than the desired amount of compression. 
Units 556 and 558 operate under control of a Min/Max comparison network 560 which determines the minimum and 
maximum pixel values for each pixel block. 

55 Quantizer 556 could also be arranged to use a fixed quantizer rule. However, it is more efficient to adapt the 

quantizer rule according to the minumum and maximum pixel values associated with the block being processed. Min/ 
Max comparison unit 560 determines these values. Element 555 provides the time delay needed for the minimum and 
maximum values of all 64 pixels of a given block to be examined before the first pixel of the block is processed. 
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Referring back to Figure 3, compressor 322 has no inhierent delay, but the combination of the min/max comparison 
and delay element 555 (Figure 5) causes compressor 322 to exhibit a one block delay, which matches the one block 
delay exhibited by the variable compression path. The fixed length compression network evaluates each of the 64 pixel 
values of each 8x8 pixel block twice to determine the minimum and maximum pixel values of that block. This process 

5 is facilitated by the 64 pixel (one block) delay provided by element 555. The minimum and maximum values are used 
to adaptively select between non-linear quantizing rules to be used for each block being processed. The two pass 
approach needed to evaluate each block twice does not add additional latency to the system because of the one block 
latency exhibited by buffer 460 of the variable compression path when determining if the variable compressor has 
achieved the desired compression. 

10 As noted above, when compressors 316 and 322 are arranged in parallel and fixed compressor employs min/max 

comparison, there is a one block delay in compressor 322. Variable compressor 316 does not have an inherent one 
block delay, so bit buffer 460 holds the bits-one block time longer in order to wait for the output of compressor 322. If 
fixed compressor 322 did not use min/max comparison, then compressor 322 would not exhibit a one block delay. 
Variable compressor 316 does not exhibit an inherent one block delay due to buffer 460. Buffer 460 stores the bits of 

IS compressor 316 before a decision is made regarding which of the variable or fixed compression outputs to use. Bit 
counter 31 8 determines which output to use when the variable and fixed compression networks are arranged in parallel. 

However, compressors 31 6 and 322 need not be arranged in parallel, as shown in Figure 8. in this case compressor 
316 processes a pixel block first, and at the same time Min/Max comparison unit 560 determines the minimum and 
maximum pixel values for the block, as explained previously. After a one block delay, it will be known whether or not 

20 compressor 316 has achieved the target compression, and thereby whether or not fixed compressor 322 needs to 
process the block. If variable compressor 316 has achieved the target compression factor, it will output the variable- 
compressed block to the frame memory. Otherwise, unit 322 will compress the block. Since compressors 31 6 and 322 
may contain similar ai-chitecture and functional elements, this implementation advantageously allows such similar el- 
ements used for variable compression in unit 316 to be used again for fixed length compression in unit 322. 

25 It is not essential to adaptively change the quantizer rules with respect to quantizer 556 of Figure 5. Simple linear 

quantization could be used. Adapting the quantizer rule according to the min/max pixel values reduces the amount of 
loss. Each block is scanned once to find the min and max pixel values. Knowledge of these values allows an appropriate 
quantizer rule to be chosen before the first (residual) value is quantized. Element 555 delays the first pixel until the 
quantizer rule is established, which rule is also used by inverse quantizer 558. This may require that signalling bits be 

30 added to the datastream to notify the decompression function of the quantizer rule that is being used. 

The quantizer may be considered as a form of look-up table, with output bits from unit 542 representing addresses. 
Quantizer 556 outputs 4-bit data in the case of 50% compression. The output of quantizer 556 is an index that is used 
by unit 558 to approximate the output of unit 542. This is where a loss may occur, since if input to unit 558 is only 4-bit 
data, only 16 data combinations are possible, while unit 542 can provide up to 256 possible outputs. The fixed com- 

3S pression network of Figure 5 does not require an output buffer. 

I n this embodiment the same DPCM predictive coding process is employed by the compression networks of Figures 
4 and 5. The current pixel being coded is predicted by using previously coded pixels, which are known to decompressors 
32 and 34 (Figure 1). The prediction process can be explained with reference to Figure 7, where pixel X is the pixel 
value to be predictively coded. Pixels A, 8 and C have been predictively coded previously and are known to the de- 

40 compression section. A prediction of X, Xp^ed' uses the values of A, B and C in accordance with the following pseudo 
code, which describes the algorithm to be used: 



45 



if (lA-CI < ei && IB-CI > 62), Xpred = B 

else if (IB-CI < ei && lA-CI > ez), Xpred = A 
else Xpred = (A+B)/2 

so Values e1 and e2 are constants representing predetermined thresholds. This algorithm is used only for pixels not 
located in the first row or the first column of the block being processed. Some exceptions are handled as follows: the 
first pixel in a block is coded very finely without reference to any other pixel, pixels in the first row use pixel value A as 
the predictor, and pixels in the first column use pixel value 8 as the predictor. Basically, this algorithm attempts to detect 
an edge. In the first case, a vertical edge is suggested between pixels C and B and between pixels A and X. Thus B 

55 is the best predictor. The second case suggests a horizontal edge between A and C and between B and X. Thus A is 
the best predictor. In the third case, no obvious edge is found. In this case both A and B are equally good predictors, 
so their average value is used. 

The disclosed block based data compression network is advantageously used to process MPEG compatible da- 
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tawords. The network exhibits nearly lossless compression for reducing the amount of memory needed to store 8x8 
luminance data or 4x4 U,V (chrominance) data. The amount of compression is selectable and may be 25% or 50%, 
for example. Low contrast, low detail image blocks are usually losslessly compressed, while high contrast, high detail 
data blocks may experience some acceptable loss, particularly in the case of 50% data compression. Although in some 
5 cases decompressed pixel blocks may exhibit differences compared to original pixel blocks, the disclosed compression 
system is preferred over horizontal detail reduction for reducing memory requirements. The compression system shown 
in Figure 3 can be used with all Profiles and all Levels of the MPEG specification, as well as to other digital data 
processing schemes. 

Although compressor 30 advantageously employs dual compression networks as shown in Figures 3 and 8, one 
10 of the compression networks can be removed to simplify the system. For example, to simplify the hardware design it 
may be sufficient in some systems to use the fixed length compression network alone. 



Claims 

IS 

1. In a system for processing image representative information, an MPEG compatible decoder characterized by; 

a decompressor (12,14) for decompressing an input datastream containing MPEG coded data to produce 
decompressed data; 

20 a compressor (30) for compressing said decompressed data to produce a recompressed data; 

a memory (20) for storing said recompresed data; and 
an input network (34,26) for processing data stored by said memory. 

2. A system according to Claim 1 , and further characterized by: 

25 a further decompressor for decompressing data stored by said memory before being provided to said output 

network. 

3. A system according to Claim 1 , further characterized by: 

30 a motion information processing network for processing decompressed data, wherein; 

said compressor compresses data processed by said motion processing network before being stored by said 
memory; and 

said output network is an image processor for processing data stored by said memory. 

35 4. A system according to claim 1 , characterized in that 

said image representative data comprises blocks of image pixel data of a predetermined size. 

5. A system according to claim 3, characterized in that said motion processing network comprises: 

40 a motion compensation network with an input for receiving stored data from said memory, and an output for 

providing motion compensated data; 

a combiner for combining said motion compensated data with said decompressed data from said decompres- 
sor; and 

said compressor conveying combined data from said combiner to an input of said memory unit. 

45 

6. A system according to claim 5 and further characterized by: 

a second decompressor for decompressing output data from said memory unit before being provided to said 
motion compensation network. 

50 7. A system according to claim 5 and further characterized by: 

a third decompressor for decompressing output data from said memory unit before being conveyed to said 
output image processor. 

8. A system according to claim 1 , characterized in that 
55 said cornpressor is a block-based compressor. 

9, A system according to claim 1 , characterized in that said compressor comprises: 
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a first compressor exhibiting a first data compression characteristic; 

a second compressor exhibiting a different second data compression characteristic and receiving data to be 
compressed concurrent with said first compressor; and 

a selection network for conveying compressed data exhibiting a desired compression factor from one or the 
5 other of said first and second compressors to said memory unit. 

10. A system according to claim 9, characterized in that 

said first compressor exhibits a variable compression characteristic; and 
10 said second compressor exhibits a fixed compression characteristic. 

1-1. A system according to claim 10, characterized in that 

said variable compression is preferred to said fixed compression such that said selection network selects 
(a) variable compressed data from said first compressor when said variable compressed data exhibits a predeter- 
15 mined desired compression factor or greater, and (b) fixed compressed data from said second compressor when 

said variable compressed data exhibits less than said compression factor. 

12. A system according to claim 1, characterized in that said compressor comprises; 

20 a block based first compressor exhibiting a variable data compression characteristic; 

a block based second compressor exhibiting a fixed data compression characteristic, said second processor 
operating in parallel with said first compressor: 

means for applying blocks of image data to both said first and second compressors concurrently: 
means coupled to said first compressor for determining if a data block processed by said first compressor 
25 exhibits a desired compression factor; and 

a selection network for selectively conveying to said utilization network (a) variable compressed data from 
said first compressor when said variable compressed data exhibits a desired predetermined compression 
factor or greater, and (b) fixed compressed data from said second compressor when said variable compressed 
data exhibits less than said compression factor. 

30 

1 3. A method of processing a digital datastream of MPEG coded image representative data characterized by the steps 

of: 

(a) decompressing said input datastream of MPEG coded data to produce decompressed data; 
35 (b) compressing said decompressed data to produce recompressed data; 

(c) storing said recompressed data; and 

(d) providing said stored recompressed data to an image information processing network. 

14. A method according to Claim 1 3, further characterized by the step of: 

•^0 (e) decompressing said stored data before providing said stored data to said inriage processing network. 

15. A method according to claim 13, characterized in that 

said compressing step (b) performs block-based compression; and 
45 said decompression step (a) performs block-based decompression. 

16. A method according to claim 1 3, further characterized by the steps of 

(e) decompressing information stored in said memory to produce output image information for display; and 
50 (f) conveying said image information for display to a display processor. 

17. A method according to Claim 1 3, further characterized by the steps of: 

(e) decompressing information stored in said memory to produce decompressed stored information; 
55 (f) motion processing said decompressed stored information to produce motion information; and 

(g) combining said motion information with said decompressed data to produce said information compressed 
in said compressing step (b). 
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